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Abstract. For many practical applications of ASP, for instance data in- 
tegration or planning, query answering is important, and therefore query 
optimization techniques for ASP are of great interest. Magic Sets are one 
of these techniques, originally defined for Datalog queries (ASP without 
disjunction and negation). Dynamic Magic Sets (DMS) are an extension 
of this technique, which has been proved to be sound and complete for 
query answering over ASP programs with stratified negation. 
A distinguishing feature of DMS is that the optimization can be exploited 
also during the nondeterministic phase of ASP engines. In particular, 
after some assumptions have been made during the computation, parts of 
the program may become irrelevant to a query under these assumptions. 
This allows for dynamic pruning of the search space, which may result 
in exponential performance gains. 

In this paper, the correctness of DMS is formally established and proved 
for brave and cautious reasoning over the class of super-consistent ASP 
programs (ASP SC programs). ASP SC programs guarantee consistency (i.e., 
have answer sets) when an arbitrary set of facts is added to them. This 
result generalizes the applicability of DMS, since the class of ASP SC pro- 
grams is richer than ASP programs with stratified negation, and in par- 
ticular includes all odd-cycle-free programs. DMS has been implemented 
as an extension of DLV, and the effectiveness of DMS for ASP SC programs 
is empirically confirmed by experimental results with this system. 



1 Introduction 

Answer Set Programming (ASP) is a powerful formalism for knowledge represen- 
tation and common sense reasoning [1]. Allowing disjunction in rule heads and 
nonmonotonic negation in bodies, ASP can express every query belonging to 
the complexity class £2 (NP^ 3 ). For this reason, it is not surprising that ASP 
has found several practical applications, also encouraged by the availability of 
efficient inference engines, such as DLV [2], GnT [3], Cmodels [4], or ClaspD [5]. 
As a matter of fact, these systems are continuously enhanced to support novel 
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optimization strategies, enabling them to be effective over increasingly larger 
application domains. Magic Sets are one of these techniques [6-8]. 

The goal of the original Magic Set method (defined in the field of Deductive 
Databases for Datalog programs, i.e., disjunction- free positive ASP programs) 
is to exploit the presence of constants in a query for restricting the possible 
search space by considering only a subset of a hypothetic program instantiation, 
which is sufficient to answer the query in question. Magic sets are extensions of 
predicates that make this restriction explicit. Extending these ideas to ASP faces 
a major challenge: While Datalog programs are deterministic, ASP programs are 
in general nondetcrministic. 

There are two basic possibilities how this nondeterminism can be dealt with 
in the context of Magic Sets: The first is to consider static magic sets, in the 
sense that the definition of the magic sets is still deterministic, and therefore 
the extension of the magic set predicates is equal in each answer set. The second 
possibility is to allow dynamic magic sets, which also allow for non-deterministic 
definitions of magic sets. This means that the extension of the magic set pred- 
icates may differ in various answer sets, and thus can be viewed as being spe- 
cialized for different answer sets. This also mimics the architecture of current 
ASP systems, which are divided into a deterministic (grounding) and a non- 
deterministic (model search) phase. 

In [9] the first Dynamic Magic Set (DMS) method has been proposed and 
proved correct for ASP with stratified negation. In this work, we show that this 
technique can be easily extended and shown to be correct for a broader class 
of programs, which we call super-consistent ASP programs (ASP SC programs), 
which includes all stratified and odd-cycle-free programs. In more detail, the 
contributions are: 

— We formally establish the correctness of DMS for ASP SC programs. In par- 
ticular, we prove that the program obtained by the transformation DMS is 
query-equivalent to the original program. This result holds for both brave 
and cautious reasoning. 

— We have implemented a DMS optimization module inside the DLV system 
[2]. In this way, we could exploit the internal data-structures of the DLV 
system and embed DMS in the core of DLV. As a result, the technique is 
completely transparent to the end user. The implementation is available at 
http : //www . dlvsystem . com/magic/. 

— We have conducted experiments on a synthetic domain that highlight the 
potential of DMS. We have compared the performance of the DLV system 
without magic set optimization and with DMS. The results show that DMS 
can yield drastically better performance than the non optimized evaluation. 

Organization. In Section 2, syntax and semantics of ASP are introduced. In this 
section, we also define ASP SC programs. In Section 3, we show how to apply DMS 
to ASP SC programs and formally prove its correctness. In Section 4, we discuss 
the implementation and integration of the Magic Set method within the DLV 
system. Experimental results are reported in Section 5. Finally, in Section 6 we 
draw our conclusions. 
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2 Preliminaries 



In this section, we recall the basics of ASP and introduce the class of super- 
consistent ASP programs (ASP SC programs). 

2.1 ASP Syntax and Semantics 

A term is either a variable or a constant. If p is a predicate of arity k > 0, and 
ti, . . . , t k are terms, then p(ti, . . . , t k ) is an atom 1 . A literal is either an atom 
p(t) (a positive literal), or an atom preceded by the negation as failure symbol 
not p(t) (a negative literal). A rule r is of the form 

Pi(ti) v ••• v p n (t n ) :- qi(si), qj(sj), not q j+1 (s j+1 ), not q m (s m ). 

where pi(ti), . . . , p n (t n ), qi(si), . . . , q m (s m ) are atoms and n > 1, m > j > 0. 
The disjunction pi(ti) v • • • v p n (t n ) is the head of r, while the conjunction 
qi(§i), qj(sj), not q j+1 (s j+1 ), not q m (s m ) is the body of r. More- 

over, H(r) denotes the set of head atoms, while B(r) denotes the set of body 
literals. We also use B + {r) and B~{r) for denoting the set of atoms appearing 
in positive and negative body literals, respectively, and Atoms(r) for the set 
H(r) U B + (r) U B~(r). A rule r is normal (or disjunction-free) if |-ff(r)| = 1, 
positive (or negation-free) if B~(r) = 0, a fact if both B(r) = 0, \H{r)\ = 1 and 
no variable appears in H(r). 

A program V is a finite set of rules; if all rules in it are positive (resp. nor- 
mal), then V is a positive (resp. normal) program. Odd-cycle- free and stratified 
programs constitute other two interesting classes of programs. A predicate p ap- 
pearing in the head of a rule r depends on each predicate q such that an atom 
q(s) belongs to B(r); if q(s) belongs to B + (r), p depends on q positively, other- 
wise negatively. A program is odd- cycle- free if there is no cycle of dependencies 
involving an odd number of negative dependencies, while it is stratified if each 
cycle of dependencies involves only positive dependencies. 

Given a predicate p, a defining rule for p is a rule r such that some atom 
p(t) belongs to H(r). If all defining rules of a predicate p are facts, then p is an 
EDB predicate] otherwise p is an IDB predicate 2 . Given a program V, the set of 
rules having some IDB predicate in head is denoted by IDB(V), while EDB(P) 
denotes the remaining rules, that is, EDB(V) = V\ IDB{V). 

The set of constants appearing in a program V is the universe of V and is 
denoted by Up 3 , while the set of ground atoms constructible from predicates in 
V with elements of Uv is the base of V, denoted by B-p. We call a term (atom, 
rule, or program) ground if it does not contain any variable. A ground atom 
p(t) (resp. a ground rule r g ) is an instance of an atom p(t') (resp. of a rule r) if 
there is a substitution from the variables in p(t') (resp. in r) to U-p such that 

1 We use the notation t for a sequence of terms, for referring to atoms as p(t). 

2 EDB and IDB stand for Extensional Database and Intensional Database, respec- 
tively. 

3 If V has no constants, then an arbitrary constant is added to U-p- 
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p(t) = p(t')t? (resp. r g = r$). Given a program V, Ground(V) denotes the set 
of all instances of the rules in V '. 

An interpretation I for a program V is a subset of Bp. A positive ground 
literal p(t) is true w.r.t. an interpretation I if p(t) G I: otherwise, it is false. A 
negative ground literal not p(t) is true w.r.t. I if and only if p(t) is false w.r.t. 
I. The body of a ground rule r g is true w.r.t. I if and only if all the body literals 
of r g are true w.r.t. I, that is, if and only if B + {r g ) C I and B~(r g ) Pl7 = 0. An 
interpretation / satisfies a ground rule r g £ Ground(V) if at least one atom in 
H{r g ) is true w.r.t. I whenever the body of r g is true w.r.t. I. An interpretation 
I is a model of a program V if I satisfies all the rules in GroundifP). 

Given an interpretation / for a program V, the reduct of V w.r.t. I, de- 
noted Ground(Py , is obtained by deleting from Ground(P) all the rules r g 
with B~(r g ) n I = 0, and then by removing all the negative literals from the 
remaining rules. The semantics of a program V is then given by the set AS(V) 
of the answer sets of V, where an interpretation M is an answer set for V if and 
only if M is a subset- minimal model of Ground(V) M . 

Given a ground atom p(t) and a program V , p(t) is a cautious (resp. brave) 
consequence of V, denoted by V \= c p(t) (resp. V |=6 p(t)), if p(t) G M 
for each (resp. some) M e AS(V). Given a query 4 Q = g(t)?, Ans c (Q,V) 
(resp. Ansi,(Q,V)) denotes the set of all the substitutions $ for the variables 
of g(t) such that V \= c g(t)$ (resp. V \=b g(t)i9). Two programs V and V are 
cautious-equivalent (resp. brave-equivalent) w.r.t. a query Q, denoted by V=qP' 
(resp. V= h Q V), if Ans c {Q, V LIT) = Ans c {Q, V U T) (resp. Ans b (Q, V U T) = 
Ansb(Q,T" U J 7 )) is guaranteed for each set of facts T defined over the EDB 
predicates of V and V' . 

2.2 Super-Consistent ASP Programs 

We now introduce super-consistent ASP programs (ASP SC programs), the main 
class of programs studied in this paper. 

Definition 1 (ASP SC programs). A program V is super-consistent if, for every 
set of facts J 7 , the program V U T is consistent, that is, AS(V U F) ^ 0. Let 
ASP SC denote the set of all super- consistent programs. 

Deciding whether a program V is ASP SC is computable. Indeed, if V is not 
ASP SC , then there is a set of facts T such that VUJ 7 is inconsistent. Such an T can 
be chosen among all possible sets of ground atoms constructible by combining 
predicates of V with constants in U-p U {£x | X is a variable of V} (assuming 
different rules have different variable names and £x does not belong to U-p): If 
the inconsistency is not due (only) to atoms in Bp but new constant symbols 
are required, then the choice of these symbols is negligible and the possibility 

4 The queries considered here allow only atoms for simplicity; more complex queries 
can still be expressed using appropriate rules. We assume that each constant ap- 
pearing in Q also appears in V; if this is not the case, then we can add to V a fact 
p(t) such that p is a predicate not occurring in V and t are the arguments of Q. 
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to instantiate each variable with a different constant is sufficient to trigger the 
inconsistency. 

ASP SC programs constitute an interesting class of programs, properly in- 
cluding odd-cycle-free programs (hence also stratified programs). Indeed, every 
odd-cycle-free program admits at least one answer set and remains odd-cycle- 
free even if an arbitrary set of facts is added to its rules. On the other hand, 
there are programs having odd-cycles that are ASP SC . 

Example 1. Consider the following program: 

a v b. a :— not a, not b. 

Even if an odd-cycle involving a is present in the dependency graph, the program 
above is ASP SC . Indeed, the first rule assures that the body of the second rule is 
false in every model, then annihilating the odd-cycle. □ 

3 Magic-Set Techniques 

The Magic Set method is a strategy for simulating the top-down evaluation of 
a query by modifying the original program by means of additional rules, which 
narrow the computation to what is relevant for answering the query. Dynamic 
Magic Sets (DMS) are an extension of this technique, which has been proved to 
be sound and complete for query answering over ASP programs with stratified 
negation. 

In this section, we first recall the DMS algorithm, as presented in [9] . We then 
show how to apply DMS to ASP SC programs and formally prove the correctness 
of query answering for this class. 

3.1 Dynamic Magic Sets 

The method of [9] 5 is structured in three main phases. 

(1) Adornment. The key idea is to materialize the binding information for 
IDB predicates that would be propagated during a top-down computation, like 
for instance the one adopted by Prolog. According to this kind of evaluation, all 
the rules r such that g(t') 6 H(r) (where g(t')$ = Q for some substitution 1?) 
are considered in a first step. Then the atoms in Atoms{r{)) different from Q are 
considered as new queries and the procedure is iterated. 

Note that during this process the information about bound (i.e. non-variable) 
arguments in the query is "passed" to the other atoms in the rule. Moreover, it 
is assumed that the rule is processed in a certain sequence, and processing an 
atom may bind some of its arguments for subsequently considered atoms, thus 
"generating" and "passing" bindings. Therefore, whenever an atom is processed, 
each of its argument is considered to be either bound (b) or free (f ). 

5 For a detailed description of the standard magic set technique we refer to [6] . 
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Input: An ASP ac program V, and a query Q = g(t)? 
Output: The optimized program DMS(Q.'P). 

var S: set of adorned predicates; modifiedRuleSQ-p ,magic Rules Q-p: set of rules; 
begin 

1. S :— 0; modifiedRules q :— 0; magicRulesQ v :— {BuildQuerySeed(Q,V , 5)}; 

2. while S ^ do 

5. p a :— an clement of S; S : — S \ {p a }; 

4-. for each rule r £ P and for each atom p(t) G H(r) do 

5. r a :— Adorn(r, p a , S 1 ); 

(5. magicRulesQ r p :— magicRulesQ r p IJ Generate (r a ): 

7. modifiedRulesQ^-p :— modifiedRulesQ^ (J { Modify(r a ) }; 

5. end for 

P. end while 

JO. DMS(g,7>): = rnagieiitiies e ,p U modifiedRulesQ iV U EDB(V); 
11. return DMS(Q, P); 
end. 



Fig. 1. Dynamic Magic Set algorithm (DMS) for ASP SC programs. 



The specific propagation strategy adopted in a top-down evaluation scheme 
is called sideways information passing strategy (SIPS), which is just a way of 
formalizing a partial ordering over the atoms of each rule together with the 
specification of how the bindings originate and propagate [8, 10]. Thus, in this 
phase, adornments are first created for the query predicate. Then each adorned 
predicate is used to propagate its information to the other atoms of the rules 
defining it according to a SIPS, thereby simulating a top-down evaluation. While 
adorning rules, novel binding information in the form of yet unseen adorned 
predicates may be generated, which should be used for adorning other rules. 

(2) Generation. The adorned rules are then used to generate magic rules defin- 
ing magic predicates, which represent the atoms relevant for answering the input 
query. The bodies of magic rules contain the atoms required for binding the 
arguments of some atom, following the adopted SIPS. 

(3) Modification. Subsequently magic atoms are added to the bodies of the 
adorned rules in order to limit the range of the head variables, thus avoiding 
the inference of facts which are irrelevant for the query. The resulting rules are 
called modified rules. 

The complete rewritten program consists of the magic and modified rules 
(together with the original EDB). Given a stratified program V, a query Q, and 
the rewritten program V, V and V' are equivalent w.r.t. Q, i.e., V= h QT" and 
V= c qP' hold [9]. 

3.2 Applying DMS to ASP SC Programs 

The algorithm DMS implementing the Magic-Set technique described in the pre- 
vious section is reported in Figure 1. The algorithm exploits a set S for storing 
all the adorned predicates to be used for propagating the binding of the query 
and, after all the adorned predicates are processed, outputs a rewritten program 
DKS(Q,P) consisting of a set of modified and magic rules, stored by means of 
the sets modifiedRules Q t -p and magicRules Q^-p , respectively. 
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We note that, even if the DMS method is presented for stratified ASP pro- 
grams, this restriction is not required by the algorithm. Indeed, in [9], stratifica- 
tion is only used to prove query equivalence of the rewritten program with the 
original program. Here we claim that DMS can be correctly applied to a larger 
class of programs, precisely that of ASP SC programs. 

We now describe the applicability of DMS to ASP SC programs, and in the next 
section we will prove its correctness for this class of programs. For illustrating 
the technique we will use the following running example. 

Example 2 (Related [10]). A genealogy graph storing information of relationship 
(father/brother) among people is given, from which a non-deterministic "ances- 
tor" relation can be derived. Assuming the genealogy graph is encoded by facts 
rel(pi,p 2 ) when pi is known to be related to p 2 , that is, when pi is the father 
or a brother of p 2 , the ancestor relation can be derived by the following ASP SC 
program V re i- 

n : fath(X,Y) :- rel(X, Y), not brot(X, Y). 
r 2 : brot(X,Y) :- rel(X, Y), not f ath(X, Y). 
r 3 : anc(X,Y) :- fath(X,Y). 
r 4 : anc(X,Y) :- fath(X,Z), anc(Z,Y). 

Given two people pi and p 2 , we consider a query Q re i — anc(pi,p 2 )? asking 
whether pi is an ancestor of p 2 . □ 

The computation starts in step 1 by initializing S and modifiedRules qj> to 
the empty set. Then the function BuildQuerySeed(Q 7 V, S) is used for storing 
the magic seed magic(g Q (t)). in magicRulesQ^-p, where a is a string having 
a b in position i if ti is a constant, or an f if ti is a variable. Intuitively, the 
magic seed states that atoms matching the input query are relevant. In addition, 
BuildQuerySeed(Q, V, S) adds the adorned predicate magic_g" into the set S. 

Example 3. Given the query Q re i = anc(pi,p 2 )? and the program P re i, Build- 
QuerySeed(Q re i, V re i,S) creates the fact magic_anc bb (p 1 , p 2 ). and inserts anc bb 
in S. □ 

The core of the algorithm (steps 2-9) is repeated until the set S is empty, i.e., 
until there is no further adorned predicate to be propagated. In particular, an 
adorned predicate p Q is removed from S in step 3, and its binding is propagated 
in each (disjunctive) rule r e V of the form 

r : p(t) v pi(t!) v • • • v p n (t n ) :- qi(§i), . . . , qj(sj), 

not q j+1 (s j+1 ), not q m (s m ). 

(with n > 0) having an atom p(t) in the head (note that the rule r is processed 
as often as head atoms with predicate p occur; steps 4~8). 
(1) Adornment. Step 5 implements the adornment of the rule according to a 
fixed SIPS specifically conceived for disjunctive programs. 
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Definition 2 (SIPS). A SIPS for a rule r w.r.t. a binding a for an atom 
p(t) G H(r) is a pair ^\ f? ^), where: 



l. -4 



p a (t) 



is a strict partial order over the atoms in Atoms(r), such that: 



(a) p(t) -<r ^ q(s), for all atoms q(s) G ylfoms(r) different from p(t); 
(&,) /or eac/i pair o/ atoms q(s) G (#(r) \ {p(t)}) U B~(r) and b(z) G 
^ Atoms(r), q(s) -<l£ ^ b(z) does nof ZioZd; cmd, 
2. fr ^ is a function assigning to each atom q(s) G Atoms(r) a subset of the 
variables in s — intuitively, those made bound when processing q(s). 

The adornments for a rule r w.r.t. an (adorned) head atom p"(t) are precisely 
dictated by (~$- ^\ fr ^); in particular, a variable X of an atom q(s) in r is 
bound if and only if either: 

1. X G ff {i) (q(s)) with q(s) = p(t); or, 

2. X G ff {t \b(z)) for an atom b(z) G B+(r) such that b(z) ~tf (t) q(s) holds. 

The function Adorn (r, p a , S) produces an adorned disjunctive rule r a from 
an adorned predicate p Q and a suitable unadorned rule r, by inserting all newly 
adorned predicates in S. Hence, in step 5 the rule r a is of the form 

r a : p a (t)vp?'(ti)v ••• vp*(t n ) :- qf^Si), q? J (sj), 

not q^+^sj+i), - not q£-(s m ). 

where each a±, . . . , a n , f3±, . . . , /3 m is either a string representing the bindings de- 
fined in 1. and 2. above (for IDB atoms), or the empty string (for EDB atoms). 

Example 4- Let us resume from Example 3. We are supposing the adopted SIPS 
is passing the bindings whenever possible, in particular 

/ r f 1 athbb(X ' Y) (fath(X,Y)) = {X,Y} 



f ath(X,Y 
fath(X,Y 

fath(X,Y 
fath(X,Y 
rel(X,Y 

brot(X,Y 
brot(X,Y 

anc(X,Y 

anc(X, Y 
anc(X, Y 
fath(X, Z 



^ th (X ' Y) rel(X,Y) 
brot(X)Y) 

^ r T hM{XJ) rel(X,Y) 
brot(X,Y) 
brot(X,Y) 

rel(X,Y) 
^r bb(XJ) fath(X,Y) 



firth ( x - Y )( rel ( X)Y )) = { X ,Y} 
/r ^ bb (xj) (brot(XjY)) = {X)Y} 



fir VA '°(fath(X,Y)) = {X} 



f fath bf (X,Y) , 

in ( 

/ r f 1 athM(XJ) (rel(X,Y)) = {X,Y} 
/ r f 1 athM(XJ) (brot(X,Y)) = {X,Y} 



b(X ' Y) fath(X,Y) 



fath(X,Z) 
anc(Z;Y) 

^f b(XJ) anc(Z,Y) 



/ r b 2 rotbb(x ' Y) (brot(X,Y)) = {X,Y} 
/ r b 2 r ° tbb(X ' Y) (rel(X,Y)) = {X,Y} 
/ r b 2 rotbb(XJ) (fath(X,Y)) = {X,Y} 

/ r a r bb(XJ) (anc(X,Y)) = {X,Y} 
/ r T bb(XJ) (fath(X,Y)) = {X,Y} 



/ r T cbb(X ' Y) (anc(X,Y)) = {X,Y} 
/ r a 4 n ° bb(XJ) (fath(X,Z))-{X,Z} 
/ r a r bb(XJ) (anc(Z,Y)) = {Z,Y} 
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When anc bb is removed from the set S, r 3 and are adorned: 

rf : anc bb (X,Y) :- fath bb (X,Y). 

r% : anc bb (X,Y) :- fath bf (X,Z), anc bb (Z,Y). 

The adorned predicates fath bb and fath M are added to S. Then, f ath bb is 
removed from S and r\ is adorned: 

rf ;1 : fath bb (X,Y) :- rel(X, Y), not brot bb (X, Y). 

Thus, brot bb is added to S. We then remove f ath bf from S and adorn n: 

rf >2 : fath M (X,Y) :- rel(X, Y), not brot bb (X, Y). 

In this case nothing is added to S. Finally, brot bb is removed from S and r 2 is 
adorned: 

r£ : brot bb (X,Y) :- rel(X, Y), not f ath bb (X, Y). 

□ 

(2) Generation. The algorithm uses the adorned rules for generating and col- 
lecting the magic rules in step 6. For an adorned atom p Q (t), let magic(p"(t)) 
be its magic version defined as the atom magic_p Q (t'), where t' is obtained 
from t by eliminating all arguments corresponding to an f label in a, and where 
magic_p a is a new predicate symbol (for simplicity denoted by attaching the pre- 
fix "magic_" to the predicate symbol p Q ). Then, if qf 1 (§i) is an adorned atom 
(i.e., Pi is not the empty string) in an adorned rule r a having p Q (t) in head, 
Generate(r a ) produces a magic rule r* such that (i) H(r*) = {magic(qf 1 (si))} 
and (ii) B(r*) is the union of {magic(p Q (t))} and the set of all the atoms 
q^(sj) £ Atoms(r) such that qj(sj) -<™ q±(Si). 

Example 5. In the program of Example 4, the magic rules produced are 

r-3 : magic Jath bb (X,Y) :- magic_anc bb (X, Y). 

r| ;1 : magic Jath bf (X) :- magic_anc bb (X, Y). 

r{ 2 : magic_anc bb (Z,Y) :- magic_anc bb (X, Y), fath(X,Z). 

r( A : magic_brot bb (X, Y) :- magic_f ath bb (X, Y). 

r{ 2 : magic_brot bb (X,Y) :- magic_f ath bf (X), rel(X,Y). 

r* 2 : magic_fath bb (X,Y) :- magic_brot bb (X, Y). 

□ 

(3) Modification. In step 7 the modified rules are generated and collected. A 
modified rule r' is obtained from an adorned rule r a by adding to its body a 
magic atom magic(p Q (t)) for each atom p Q (t) e H{r a ) and by stripping off the 

6 Note that, according to the SIPS described above, variable Z in anc(Z, Y) is considered 
bound because of f ath(X, Z) ^ cbb(x ' Y) anc(Z,Y) and /™ cb " (x ' Y) (f ath(X, Z)) = {X, Z}. 
Choosing a different SIPS would result in a different (still correct) program. 
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adornments of the original atoms. Hence, the function Modify (r a ) constructs a 
rule r' of the form 

r' : p(t) v pi(ti)jv ••• vp n (t n ) :- magic(p Q (t)),magic(p" 1 (t 1 )),..., 

magic(p^(t n )),qi(s 1 ), . . . ,q j (s j ),not q j+1 (s j+1 ), not q m (s m ). 

Finally, after all the adorned predicates have been processed, the algorithm 
outputs the program DMS(Q, 7-*). 

Example 6. In our running example, we derive the following set of modified rules: 

r' 3 : anc(X,Y) :— magic_anc bb (X, Y), fath(X,Y). 

r\ : anc(X,Y) :— magic_anc bb (X, Y), fath(X, Z), anc(Z,Y). 

r[ A : fath(X,Y) :— magic_f ath bb (X, Y), rel(X,Y), not brot(X, Y). 

r' l 2 : fath(X,Y) :- magicjf ath bf (X, Y), rel(X,Y), not brot(X, Y). 

r' 2 : brot(X,Y) :- magic_brot bb (X, Y), rel(X, Y), not f ath(X, Y). 

The optimized program DMS(Q re ;, V re i) comprises the above modified rules 
as well as the magic rules in Example 5, and the magic seed magic_anc bb (p!, p 2 ). 
(together with the original EDB). □ 



3.3 Query Equivalence Results 

We conclude the presentation of the DMS algorithm by formally proving its cor- 
rectness. This section essentially follows [9], to which we refer for the details, 
while here we highlight the necessary considerations for generalizing the results 
of [9] to ASP SC queries. Throughout this section, we use the well established 
notion of unfounded set for disjunctive programs with negation defined in [11]. 
Since we deal with total interpretations, represented as the set of atoms inter- 
preted as true, the definition of unfounded set can be restated as follows. 

Definition 3 (Unfounded sets). Let I be an interpretation for a program V, 
and X C B-p be a set of ground atoms. Then X is an unfounded set for V 
w.r.t. I if and only if for each ground rule r g £ Ground{V) with X PiH(r g ) ^ 0, 
either (l.o) B+{r g ) %I, or (1.6) B-{r g )C\I^%, or (2) B+{r g )C\X or (3) 
H(r g )n(I\X)^9. 

Intuitively, conditions (l.o), (1.6) and (3) check if the rule is satisfied by 
I regardless of the atoms in X, while condition (2) assures that the rule can 
be satisfied by taking the atoms in X as false. Therefore, the next theorem 
immediately follows from the characterization of unfounded sets in [11]. 

Theorem 1. Let I be an interpretation for a program V . Then, for any answer 
set M 3 L ofV, and for each unfounded set X of V w.r.t. I , M PlX = holds. 

We now prove the correctness of the DMS strategy by showing that it is sound 
and complete. In both parts of the proof, we exploit the following set of atoms. 



10 



Definition 4 (Killed atoms). Given a model M for TMS(Q,V), and a model 
N C M of Ground(DHS(Q,T)) M , the set killed^ (N) of the killed atoms 
w.r.t. M and N is defined as: 

{ p(t) G Bp \ N | either p is EDB, or some magic(p Q (t)) belongs to N }. 

Thus, killed atoms are either false instances of some EDB predicate, or false 
atoms which are relevant for Q (since a magic atom exists in N). Therefore, we 
expect that these atoms are also false in any answer set for V containing MnBp. 

Proposition 1. Let M be a model for DMS(Q, 7-*), and N C M a model of 
Ground(DHS(Q,V)) M . Then killed^ (iV) is an unfounded set for V w.r.t. 
MOB-p. 

Proof. See [9], proof of Proposition 3.15. □ 

For proving the completeness of the algorithm we provide a construction for 
passing from an interpretation for V to one for DMS^P). 

Definition 5 (Magic variant). Let I be an interpretation for V . We define 
an interpretation varg P (J) for DMS(Q,'P), called the magic variant of L w.r.t. 
Q and V, as the fixpoint of the following sequence: 

vzr% v {I) = EDB{V) 

varg"p(7) = varg -p(L) U {p(t) G L \ some magic(p Q (t)) belongs to var^ -p(I)} 
U {magic(p° ! (t)) 3 r* G Ground(TMS(Q, V)) such that 

magic(p Q (t)) G H(r* g ) and B+{r* g ) C var 4 Q p (L)}, Vi > 

By definition, for a magic variant varg v (L) of an interpretation I for V, 
var Q-p(I) H Bp G L holds. More interesting, the magic variant of an answer set 
for V is in turn an answer set for DMS(Q,7 : ') preserving the truth/falsity of Qi3, 
for every substitution 

Lemma 1. For each answer set M ofV, there is an answer set M' o/DMS(Q, V) 
(which is the magic variant of M) such that, for every substitution Qd G M 
if and only if Qd G M' . 

Proof. We can show that M' = varg P (7) is an answer set of DMS(<2, V) (see [9], 
proof of Lemma 3.21). Thus, since Qd belongs either to M 1 or to killed^f .p(M'), 
for every substitution the claim follows by Proposition 1. □ 

Proving the soundness of the algorithm requires quite more attention. Indeed, 
if the technique is used for a program which is not ASP SC , the rewritten program 
might provide some wrong answer. 

Example 7. Consider the program 

edb(a). q(X) v p(X) :- edb(X). co(X) :- q(X), not co(X). 
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and the query q(a)?. The program above admits a unique answer set, namely 
{edb(a),p(a)}. Applying DMS will result in the following program: 

edb(a). magic_q b (a). magic_p b (X) :— magic_q b (X). 
magic_q b (X) :— magic_p b (X). 

q(X) v p(X) :- magic_q b (X), magic_p b (X), edb(X). 

The rewritten program has two answer sets, namely {magic_q b (a), magic_p b (a), 
edb(a),p(a)} and {magic_q b (a), magic_p b (a), edb(a), q(a)}. Therefore, q(a) is a 
brave consequence of the rewritten program but not of the original program. We 
note that the original program is not ASP SC ; indeed, an inconsistent program 
can be obtained by adding the fact q(a). □ 

The soundness of the algorithm for ASP SC programs is proved below. 

Lemma 2. Let Q be a query over an ASP SC program V . Then, for each an- 
swer set M' o/DMS(Q, V), there is an answer set M of V such that, for every 
substitution §, Q$ E M if and only if Qd E M' . 

Proof. Consider the program V U (M' n B-p), that is, the program obtained by 
adding to V a fact for each atom in M' n B-p. Since V is ASP SC , there is at least 
an answer set M for V U (M' n B-p). Clearly M D M' n B-p; moreover, we can 
show that M is an answer set of V as well (see [9], proof of Lemma 3.16). Thus, 
since Q& belongs either to M' or to killedg f .p(M'), for every substitution #, 
the claim follows by Proposition 1. □ 

From the above lemma, together with Lemma 1, the correctness of the Magic 
Set method with respect to query answering directly follows. 

Theorem 2. Let V be an ASP SC program, and let Q be a query. Then both 
DKS(Q,V)= b Q V andDnS(Q,P)= c Q P hold. 

4 Implementation 

The Dynamic Magic Set method (DMS) has been implemented and integrated 
into the core of DLV [2], as shown in the architecture reported in Figure 2. 

In our prototype, the DMS algorithm is applied automatically by default when 
the user invokes DLV with -FB (brave reasoning) or -FC (cautious reasoning) 
together with a (partially) bound query. Magic Sets are not applied by default 
if the query does not contain any constant. The user can modify this default 
behavior by specifying the commanddine options -DDMS (for applying Magic 
Sets) or -DDMS- (for disabling magic sets). 

Within DLV, DMS is applied immediately after parsing the program and the 
query by the Magic Set Rewriter module. The rewritten program is then pro- 
cessed by the Intelligent Grounding module and the Model Generator module 
using the standard DLV implementation. The only other modification with re- 
spect to standard DLV is for the output and its filtering: For ground queries, the 
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Fig. 2. Prototype system architecture. 



witnessing answer set is no longer printed by default, but only if — print-model 
is specified, in which case the magic predicates are omitted from the output. 

An executable of the DLV system supporting the Magic Set optimization is 
available at http://www.dlvsystem.com/magic/. 



5 Experimental Results 

In order to evaluate the impact of the proposed method, we have compared DMS 
with the traditional DLV evaluation without Magic Sets on several instances of 
the Related problem introduced in Section 3. In our benchmark, the structure of 
the "genealogy" graph consists of a square matrix of nodes connected as shown 
in Figure 3, and the instances are generated by varying the number of nodes 
(thus the number of persons in the genealogy) of the graph. We are interested 
in deciding whether the top-leftmost person can be an ancestor of the bottom- 
rightmost person (i.e., the benchmark is designed for brave reasoning). This 
setting has been used in [10] for a disjunctive, negation-free ASP encoding. 

The experiments have been performed on a 3GHz Intel® Xeon® proces- 
sor system with 4GB RAM under the Debian 4.0 operating system with a 
GNU/Linux 2.6.23 kernel. The DLV prototype used has been compiled using 
GCC 4.3.3. For each instance, we have allowed a maximum running time of 600 
seconds (10 minutes) and a maximum memory usage of 3GB. 

The results for Related are reported in Figure 3. Without magic sets, DLV 
solves only the smallest instances, with a very steep increase in execution time. 
In this case, the exponential computational gain of DMS over DLV with no magic 
sets is due to the dynamic optimization of the model search phase resulting 
from our magic sets definition. Indeed, DMS include nondeterministic relevance 
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Fig. 3. Related: Instance structure (left) and average execution time (right). 



information that can be exploited also during the nondeterministic search phase 
of DLV, dynamically disabling parts of the ground program. In particular, after 
having made some choices, parts of the program may no longer be relevant to 
the query, but only because of these choices, and the magic atoms present in the 
ground program can render these parts satisfied, which means that they will no 
longer be considered in this part of the search. 

6 Conclusion 

The Magic Set method is one of the most well-known techniques for the optimiza- 
tion of positive recursive Datalog programs due to its efficiency and its generality. 
In this paper, we have elaborated on the issues addressed in [9], In particular, we 
have showed the applicability of DMS for ASP SC programs. With DMS, ASP compu- 
tations can exploit the information provided by magic set predicates also during 
the nondeterministic stable model search, allowing for potentially exponential 
performance gains with respect to unoptimized evaluations. 

We have established the correctness of DMS for ASP SC by proving that the 
transformed program is query-equivalent to the original program. A strong rela- 
tionship between magic sets and unfounded sets has been highlighted: The atoms 
that are relevant w.r.t. a stable model are either true or form an unfounded set. 

DMS has been implemented in the DLV system. Experimental activities on 
the implemented prototype system evidenced that our implementation can out- 
perform the standard evaluation in general also by an exponential factor. This is 
mainly due to the optimization of the model generation phase, which is specific 
of our Magic Set technique. However, we would like to point out that in general 
we expect a trade-off between the larger ground program due to the presence of 
ground magic atoms and its capability of pruning the search space. 

As a final point, we would like to point out the relationship of this work 
to [12]: There, a Magic Set method for disjunction- free programs has been de- 
fined and proved to be correct for consistent programs. First, that method will 
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not work for programs containing disjunction. Second, observe that consistent 
programs are not necessarily in ASP SC ; indeed the method of [12] has to take 
special precautions for relevant parts of the program that act as constraints 
(called dangerous rules) and thus may impede a relevant interpretation to be an 
answer set. The definition of ASP SC implies that programs in this class cannot 
contain relevant dangerous rules, which allows for the simpler DMS strategy to 
work correctly. 
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